Skip to content

feat: support model-service proxy#166

Closed
BCeZn wants to merge 1 commit intomasterfrom
feature/xinshi/proxy-model-service
Closed

feat: support model-service proxy#166
BCeZn wants to merge 1 commit intomasterfrom
feature/xinshi/proxy-model-service

Conversation

@BCeZn
Copy link
Collaborator

@BCeZn BCeZn commented Dec 18, 2025

closes #165

@BCeZn BCeZn requested a review from StephenRi December 18, 2025 07:14
@BCeZn BCeZn force-pushed the feature/xinshi/proxy-model-service branch from 2f4d0dc to b1d713f Compare December 18, 2025 07:18

# Model Service Config
ROCK_MODEL_SERVICE_DATA_DIR: str
ROCK_MODEL_SERVICE_PROXY_TARGET_URL: str
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里至少得是个map<model_name, base_url>。一个agent可能得调用多个模型,不同的模型可能是不同的服务商。

@BCeZn BCeZn marked this pull request as draft December 18, 2025 09:24
@BCeZn BCeZn closed this Jan 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Impl Proxy Model Service

2 participants